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© Method and apparatus for displaying simulated keyboards on touch-sensitive displays. 



© A general-purpose, simulated keyboard for use 
on a touch-sensitive display of a computer system is 
generated independent of any applications run on 
the computer system. The simulated keyboard is 
displayed on the touch-sensitive display at manually 
or automatically set positions with respect to a 
concurrently-displayed application output screen. Al- 
ternate automatic positioning modes either position 



the simulated keyboard in the non-active portion of 
the display in response to the position of the cursor, 
or position the simulated keyboard in a portion of the 
display while displaying a height-compressed ver- 
sion of the application output screen in the remain- 
ing portion of the display. 
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METHOD AND APPARATUS FOR DISPLAYING SIMULATED KEYBOARDS ON TOUCH-SENSITIVE DIS- 
PLAYS 



FIELD OF THE INVENTION 



This invention relates to computer systems and 
more particularly to touch-sensitive input/output 
("I/O") devices thereof. 



BACKGROUND OF THE INVENTION 



Heretofore, personal computers and computer 
terminals have been suggested which use touch- 
sensitive displays as inter-active user-interfaces for 
both input and output of information (Le. f text and 
graphics). A touch sensitive display of this type 
generally has a conventional video display screen 
provided with a transparent touch-sensitive screen 
as a frontplate. Typically, the touch sensitive dis- 
play is used in conjunction with application pro- 
grams specifically designed to take advantage of 
this type of I/O device. In use, some such applica- 
tion programs can cause the display screens to 
display simulated conventional typewriter key- 
boards. The simulated keyboard is then available 
for entering data and commands for later use or 
execution in the application program that generated 
the keyboard. Thus, the simulated keyboards in 
such applications are dedicated for use only in the 
specific applications in which they have been pro- 
grammed. 

In known simulated keyboards of this type, 
each key of the simulated keyboard is represented 
by a discretely-defined area bounded by a frame. 
In each key frame there appears an indicium of an 
alpha-numeric character, or a character represent- 
ing punctuation, other symbol, or function. The 
simulated keyboard is visible through the touch- 
sensitive-screen overlaying the display. 

For typing on the simulated keyboard, the user 
touches the touch-sensitive-screen on the dis- 
played keys in the same fashion that a typist uses 
a conventional typewriter. The "touches" on the 
display cause the generation of coded electrical 
signals corresponding to the locations that are 
touched, and thereby representing the displayed 
characters (e.g., capital or lower case letters de- 
pending on whether the displayed shift key is 
touched) or functions selected by the user. The 
coded electrical signals then are processed by the 
computer in the same manner that it would process 
the electrical signals generated by a conventional 
keyboard input device. 

Unfortunately, using the touch-sensitive display 



as a combination I/O device presents certain com- 
plications. For instance, when the simulated key- 
board is "called up" and displayed on the screen, 
it may very well occupy the entire raster or a 

5 substantial portion thereof. Inorder to accommo- 
date such a simulated keyboard, either the normal 
output screen of that program must be removed 
from view in its entirety, or the window in which the 
simulated keyboard appears must be an overlay 

w which replaces and, thereby, removes from view, a 
substantial portion of the program's normal output 
screen. 

Clearly, this would not be suitable for running 
standard, commercially-available software pack- 

75 ages such as data processing, spread sheets, or 
data-base management programs, even if such 
simulated keyboards were made available within 
these programs. 

If the simulated keyboard were positioned in 

20 the same place on the screen whenever it were 
displayed in such programs, the simulated key- 
board, as often as not, would replace or cover the 
"active portion" of the software output screen. The 
active portion is the area of the screen into which 

25 the information being typed is to be entered. It is 
easy to understand that, if the user must enter data 
in such programs without the active portion of the 
software output screen being visible, data-entry ac- 
curacy and/or efficiency would suffer, to say the 

30 least. 

Accordingly, simply incorporating a touch-sen- 
sitive simulated keyboard in such programs would 
result in geometric conflicts between the normal 
software output screen and the simulated keyboard 

35 window. 

Notwithstanding, a number of patents have 
suggested the use of touch sensitive displays and 
simulated keyboards. United States Patent Nos. 
4,071.691, 4,198,539, 4,293,734, 4,371,746 and 

40 4,476,463 disclose touch-sensitive screens. U.S. 
Patent No. 4,202,041 discloses the use of a simu- 
lated keyboard displayed on a touch sensitive dis- 
play. 

In addition, U.S. Patent No. 4,763,356 discloses 
45 the use of a simulated typewriter-type keyboard on 
a touch-sensitive display used specifically in filling 
out electronic forms. This patent even suggests a 
limited solution for the geometric conflict problem 
mentioned above; namely, whenever the applica- 
60 tion displays a simulated keyboard, the user can 
move the keyboard each time it appears so as not 
to cover a user-selectable portion of the screen. 
For that purpose, a movement icon is displayed 
with the simulated keyboard, and when the move- 
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ment icon is touched by the user, the displayed 
keyboard is moved in the direction of the point 
touched. 

SUMMARY OF THE INVENTION 



The invention resides in the provision of a 
touch-sensitive simulated keyboard which is a 
general-purpose, rather than application-dedicated, 
I/O tool- similar in that way to a conventional 
keyboard device or mouse. The simulated key- 
board program remains resident in computer mem- 
ory and can be used at the discretion of the 
computer user at any time in conjunction with any 
application program run on the computer. 

In addition, the invention resides in techniques 
for automatically positioning a simulated keyboard, 
e.g., a typewriter-type keyboard, to avoid geometric 
conflicts between the active portion of a normal 
software output screen and the simulated keyboard 
window. 

In a first positioning technique in accordance 
with the invention, the simulated keyboard is posi- 
tioned automatically in a part of the screen which 
does not include the active region. The active re- 
gion is indicated by the cursor. In a preferred 
embodiment, the simulated keyboard is positioned 
in the bottom portion, e.g. the bottom half, of the 
screen whenever the cursor is located in the top 
half of the screen, and vice versa. 

In a second positioning technique, the key- 
board automatically appears in a portion of the 
screen, e.g., the bottom half, while the software 
output screen appears in its entirety, though re- 
duced in height (e.g., by 50%), in another portion, 
e.g. the top half, of the screen. In other words, 
using this approach, none of the software output 
screen is concealed by the simulated keyboard, 
but rather concurrent display of both in their en- 
tirety is achieved. In a sense, this approach is 
tantamount to providing electronically a second dis- 
play when needed for the concurrent display of 
input and output screens, albeit, using height com- 
pression to "squeeze" a full screen's information 
into a half screen with an attending decrease in 
resolution. 

Preferably, both of the above-mentioned tech- 
niques are user-selectable alternatives. For in- 
stance, in a preferred embodiment, on touching a 
displayed control button and making a selection 
from a menu, the computer user activates the 
simulated keyboard and can cause it to be posi- 
tioned automatically with respect to the cursor, i.e., 
use the above-mentioned first positioning tech- 
nique, whenever the simulated keyboard is dis- 
played. Alternatively, on selecting a different menu 



entry, the computer user can cause both the ap- 
plication output screen and the simulated keyboard 
input screen to be concurrently displayed, i.e., use 
the above-mentioned second positioning technique, 
s whenever the simulated keyboard is called to 
screen. 

Preferably, also, the computer user is provided 
with a third option, that of manually locating the 
simulated keyboard at any desired position on the 

70 display raster. In addition. onceactivated, the simu- 
lated keyboard can be displayed on the screen or 
removed therefrom simply by touching a displayed 
toggle control button. 

As indicated above, the touch-sensitive key- 

75 board in accordance with the invention is prefer- 
ably a general-purpose input/output device that is 
controlled at the operating system level rather than 
the software application level. In other words, the 
control of the simulated keyboard display, including 

20 its position within the display's raster and, in the 
first technique, with respect to the cursor, is^the 
responsibility of the basic input/output services of 
the computer. In this way, the touch-sensitive key- 
board is resident within the computer as a system 

25 utility and is independent of any specific applica- 
tion run on the computer. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 

For a fuller understanding of the nature^ and 
objects of the invention, reference should be had to 
the following detailed description taken in connec- 
ts tion with the accompanying drawings, in which: 

FIGURE 1 is a block diagram of a computer 
system in accordance with the invention; 
FIGURES 2A and 2B are front views of the 
touch sensitive display of FIGURE 1, respec- 
40 tiveiy showing an initial screen having only con- 
trol buttons being displayed thereon, and a func- 
tion menu screen called to the display on press- 
ing one of the control buttons; 
FIGURES 3A through 3G are exemplary screens 
45 displayed on the touch sensitive display of FIG- 
URE 1 , which illustrate simulated keyboard posi- 
tioning techniques in accordance with the inven- 
tion; and 

FIGURES 4 through 8 depict, in flow chart form, 
so an algorithm for displaying and using a touch- 
sensitive simulated keyboard on the computer 
system of FIGURE 1. 

55 DETAILED DESCRIPTION OF PREFERRED £M- 
BODIMENT 
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FIGURE 1 shows a computer system 10 in 
accordance with a preferred practice of the inven- 
tion. At the working heart of the system 10 is a 
central processing unit ("CPU") 12 which commu- 
nicates with a memory 14 and peripherals via a 
bus 15. These peripherals include an interactive 
user interface 16, touch screen controller 18 and 
display controller 20. 

The user interface 16 has a transparent touch- 
sensitive input screen or panel (the "touch screen") 
24 and a conventional display unit 26. The display 
unit 26 has an output screen 28. Preferably, the 
touch screen 24, overlays, i.e., mounts as a front- 
plate directly over, the output screen 28. Shown on 
the output screen 28 is a simulated keyboard, 
generally designated at K. 

More specifically, the touch screen 24 in a 
preferred embodiment is a glass plate coated on its 
touch-sensitive side 24a (i.e., the side facing away 
from the output screen 28) with a resistive material, 
and then covered on that side with a Mylar contact 
sheet (not separately shown). The contact sheet is 
maintained at a small, substantially-uniform dis- 
tance from the touch-sensitive side of the glass 
plate. Pressure exerted on the contact sheet by a 
finger, stylus or other object, (herein called a 
"touch") causes the contact sheet to make elec- 
trical contact with the resistive coating. 

In use, the touch screen controller 18 im- 
presses a voltage gradient across the resistive 
coating alternately in the n x rt (i.e., horizontal) and 
« y « (i.e., vertical) directions. By establishing a volt- 
age divider circuit, the touch produces voltage sig- 
nals detectable by the touch screen controller 18 
which are representative of the average Cartesian 
coordinates in the x- and y- directions of the 
touched area of the screen. 

These voltage signals are converted to digital 
signals by the touch screen controller 18. These 
digital signals represent each of, for instance, 256, 
discrete positions on the touch screen 24 in each 
direction. To accomplish this, for example, two 8- 
bit bytes are used to represent the x-coordinate. 
and two 8-bit bytes are used to represent the y- 
coordinate. Thus, the digital signal representing 
each such touch constitutes a coordinate set hav- 
ing the following format 



x 1 x 2 , 



3 4 5 
Yl Y 2 



where n x, n and "x z " are the two bytes or char- 
acters representing the x-coordinate, and n yi rt and 
rt y 2 " are the two bytes or characters representing 
the y-coordinate. Each such five-character coordi- 
nate set completely defines a touch. 



The five-character coordinate sets are transmit- 
ted by the touch screen controller 18 over the 
communication bus 15 to the CPU 12 for process- 
ing. A suitable communication signal for transmit- 
s ting the coordinates to the CPU 12 preferably in- 
cludes alignment bits added as a header and be- 
tween each of the characters to identify their 
boundaries, thereby aiding data recovery at the 
CPU 12. Suitable touch screens and touch screen 
70 * controllers are commercially^yailable. e.g., from 
ELO GRAPH ICS of Oak Ridge. Tennessee, U.S.A. 

The CPU 12 receives the coordinate sets from 
the touch-screen controller 18, and stores the sets 
as data structures 14a each sequentially in an x.y 
75 buffer 14a. which is. for example, a six-byte section 
of the memory 14. The CPU 12 includes a cursor 
control 35 for tracking and storing the location of 
the cursor, and controlling its position on the dis- 
play. Both the CPU 12 and memory 14 can be 
20 implemented using conventional, commercially 
available hardware. 

The memory 14 also includes a flag buffer 14b, 
a keyboard buffer 14c, a keyboard offset buffer 
14d, a character table buffer 14e and a character 
25 buffer 14f. These are described below. 

The display 26 is preferably a liquid crystal 
display which is back lit. A suitable size for the 
raster of the display 26 is, for example. 640 x 400 
(i.e., 400 rows of pixels, with 640 pixels in each 
30 row), although other raster sizes providing a dif- 
ferent number of rows or a different number of 
pixels in each row also can be used. Known dis- 
plays having substantially fewer than 400 rows of 
pixels, e.g., displays having 200 rows of pixels, 
35 however, typically have insufficient resolution for 
implementing the positioning technique entailing 
height compaction, which is described below. 

The computer system 10 can also include oth- 
er components and features conventionally found 
40 in personal computers or computer terminals. Com- 
puter 10 is shown and described only to the extent 
necessary to convey an enabling understanding of 
the best mode of implementing the invention, as 
will be apparent to those skilled in the art 
45 FIGURES 2A and 2B depict display layouts for 

the touch-sensitive display 26 showing two control 
"buttons" (i.e.. keys): a touch screen function but- 
ton 34 appears in the lower right-hand corner of the 
screen 28, and a display/remove keyboard toggle 
50 button 36 appears in the lower left-hand comer of 
the screen 28, as viewed in those drawings. 

When the touch screen function button 34 is 
pressed (i.e.. touched), a menu 38 appears on- 
screen, as shown in FIGURE 2B. The user can 
55 then select one or more entries (i.e., "functions") in 
the menu 38. As shown, the first function, AC- 
TIVATE KEYBOARD, when selected, causes a key- 
board, e.g., a conventional 101-key QWERTY type- 
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writer keyboard K to be activated or enabled so 
that it appears on screen on user command. The 
second function, DE- ACTIVATE KEYBOARD, when 
selected, causes the previously activated simulated 
keyboard K to be deactivated. The third function. 
AUTO-KEYBOARD POSITIONING, when selected, 
causes the simulated keyboard K to be positioned 
automatically with respect to the cursor to appear 
on the screen in a portion thereof away from the 
active area of the screen. The fourth function, 
MANUAL KEYBOARD POSITIONING, when select- 
ed, causes the simulated keyboard K to be posi- 
tioned in a user movable location on the screen. 
The fifth function, SPLIT SCREEN TO DISPLAY 
BOTTOM KEYBOARD, when selected, causes the 
simulated keyboard K to appear in the bottom 
portion of the screen and, simultaneously therewith, 
causes the software output screen to appear in its 
entirety in height-compacted form, in the opposite, 
i.e., top, portion of the screen. The sixth function. 
EXIT, when selected, causes the menu 38 to dis- 
appear from view. 

After the computer user has activated the sim- 
ulated keyboard K and otherwise made his/her 
selections from the menu 38, the computer system 
10 is ready for entry of data or commands, using 
the simulated keyboard K. The simulated keyboard 
K can be used to enter data or commands for 
running, for example, commercially-available stan- 
dard software packages such as data processing, 
spread sheet and data-base management pro- 
grams, which have been designed for use with 
conventional keyboard devices. It can be appre- 
ciated that the simulated keyboard K is a general- 
purpose input device, useful in conjunction with a 
broad range of computer application programs. 

Whenever information is to be entered, the 
previously-activated simulated keyboard K is dis- 
played on user-command, i.e., by the user pressing 
the display/remove keyboard toggle button 36. 
When the simulated keyboard K is not desired, it is 
removed from the screen by again pressing button 
36- The button 36 only will cause the simulated 
keyboard K to appear if the keyboard K has been 
activated (and not thereafter deactivated) using the 
touch screen function button 34. Whenever called 
to the screen by pressing of toggle button 36, the 
simulated keyboard K will appear in the position 
determined by the user's selection of one of the 
third, fourth, or fifth functions of the menu 38. If the 
user fails to make such a selection after activating 
the simulated keyboard K, then the simulated key- 
board K is positioned in accordance with, e.g., the 
third function, AUTO KEYBOARD POSITIONING, 
which is selected by the computer as the default 
positioning technique. 

A better understanding of the different modes 
of displaying the simulated keyboard K in accor- 



dance with the invention can be had with reference 
to FIGURES 3A through 3G. FIGURE 3A depicts an 
illustrative example of a software output screen 40 
having multiple columns 40A, 40B, 40C, each of 
5 four lines, of numbers. In addition to the displayed 
numbers, the output screen 40 in FIGURE 3A also 
has the control buttons 34, 36 in the same posi- 
tions as in FIGURES 2A and 2B. The FIGURES 3B 
through 3G each show a portion of the output 
w screen 40 in addition to an mjput screen, as de- 
scribed below. 

In FIGURES 3B and 3C, a simulated keyboard 
K appears over a portion of the screen 40, as if it 
had been displayed by the computer in AUTO- 
75 MATIC POSITIONING mode. In other words, when- 
ever the toggle button 36 is pressed, the 
previously-activated simulated keyboard K appears 
on screen in a window 44 occupying, e.g., as 
shown in FIGURE 3B, a bottom portion 46a of the 
20 display 28 if a cursor 48 is in a top portion 46b, 
and, as shown in FIGURE 3C, occupying the top 
portion 46b if the cursor 48 is in the bottom portion 
46b. The cursor 48 indicates, as stated above, the 
active portion (e.g., half) of the screen in which 
25 information is being inserted, deleted or manipu- 
lated by the simulated keyboard K, or, simply, 
which is of interest to the computer user. 

As can be seen, the active half of the software 
output screen and the simulated keyboard K are 
30 displayed concurrently. This occurs regardless of 
whether the active half is the top or bottom portion 
46a, 46b of the screen. The computer system 10 
automatically changes the position of the simulated 
keyboard K when the active half of the screen 
35 changes. Thus, when the cursor 48 is moved to 
occupy the opposite portion 46a, 46b of the screen 
(for example, by a computer user manipulating its 
position using the simulated keyboard K), the simu- 
lated keyboard, itself, changes positions. 
40 In addition, the control buttons 34, 36 are shift- 

ed to occupy the corners of the screen in the half 
not containing the simulated keyboard K. Of 
course, if the simulated keyboard K does not oc- 
cupy the full raster of the screen from left to right 
45 (as viewed in these drawings), then the control 
buttons 34, 36 need not shift locations as just 
described. In that case, the buttons 34, 36 can 
remain in, for example, the bottom portion of the 
screen. 

so FIGURES 3D and 3E illustrate the MANUAL 

POSITIONING mode. In these drawings, the simu- 
lated keyboard K appears in the portion of the 
screen, e.g., top, bottom or any intermediate por- 
tion, selected by the computer user, regardless of 

55 where the cursor 48 is located. In FIGURE 3D. the 
simulated keyboard K is located in a window 44 in 
an intermediate portion 46c of the screen, and the 
cursor 48 happens to be above the keyboard win- 
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<j 0W 44 t although it also could have been below or 
blocked from view by the keyboard window 44. A 
reason for this is that, in MANUAL POSITIONING 
mode, the position of the simulated keyboard K is 
independent of the position of the cursor. 

In FIGURE 3E, the simulated keyboard window 
44 is again in the intermediate portion 46c of the 
screen, though one line of text higher, and there- 
fore, masking the cursor 48 from view. Thus, if text 
is being entered using the simulated keyboard K, 
the location in which the entered text would nor- 
mally appear is hidden from view on the screen of 
FIGURE 3E. 

To manually position the simulated keyboard 
K, a manual-positioning tool 50, as shown in FIG- 
URE 3F, Is displayed in a window 52 on the screen 
when the manual keyboard positioning function is 
selected. The manual-positioning tool 50 includes 
arrows 54 pointing in left, right, up and down as 
viewed in that drawing, in each of four orthogonally 
related directions. Touching any of the arrows 54 
causes the window 52 to shift in the direction to 
which the touched arrow points. The simulated 
keyboard K will then appear shifted in the same 
direction by the amount selected by the user. Of 
course, if the simulated keyboard K occupies the 
full rastor of the screen from left to right, then it 
only can be manually moved up or down. 

As shown in FIGURE 3G. in SPLIT SCREEN 
mode, whenever toggle button 36 is pressed, the 
previously activated simulated keyboard K appears 
in, e.g., the bottom portion 46a of the screen. At 
the same time, the software output screen, along 
with the toggle buttons 34, 36, appear in. e.g., the 
top portion 46b of the screen. Thus, what pre- 
viously was a full screen of software output in- 
formation now appears in only half the screen. This 
is achieved by reducing the number of pixels in the 
y- direction used to display the information, which 
effects a reduction in the height of the displayed 
characters, i.e., height compression. 

Such compression also reduces the resolution 
of these characters. Fortunately, with conventional 
displays having, for example, approximately 400 or 
more rows of pixels, it has been found that the 
decrease in resolution is not so significant as to 
have a deleterious effect on legibility of the char- 
acters on the screen. On the other hand, it is 
believed that, for many applications, this technique 
can not be implemented on screens having ap- 
proximately 200 or less rows of pixels without 
effecting legibility. 

Simulated Keyboard Algorithm 



The simulated keyboard K is displayed and 




577 A2 10 



used pursuant to a computer program stored in, for 
example, memory 14 (FIGURE 1). An enabling 
understanding of that program now will now be 
provided by describing a suitable algorithm 100 
5 therefor. 

FIGURE 4 depicts, in flow chart form, a simu- 
lated keyboard call-up routine 100a of algorithm 
100, which is called KEYBOARD ENTRYPOINT. In 
block 102, an x.y coordinates set data structure 
w from the x.y buffer 14a (FIGURE 1) is fetched. 

Then, in block 104, this fetched data structure 
is tested to determine whether it contains a valid 
set of coordinates of a touch, i.e., whether the first 
byte thereof is set If it is not set. then the x.y 
75 coordinates set is not valid, and the algorithm 100 
proceeds to block 106 (as indicated by the letter 
"B" appearing in the balloon in the drawing) at 
which normal keyboard processing can be carried 
out. Such normal processing can include the use of 
20 a conventional keyboard device (not shown). On 
the other hand, if the first byte is set, then a valid 
set of coordinates has been fetched, and the al- 
gorithm 100 proceeds to block 108. 

Here, the fetched coordinates are tested to 
25 determine whether they correspond to the coordi- 
nates of the touch screen keyboard control keys 
34, 36 (FIGURE 2A). If the coordinates do cor- 
respond to those of the buttons 36, 38. then, as 
illustrated by block 110. the algorithm 100 calls a 
30 TOUCHSCREEN FUNCTIONS ROUTINE 100b. 

The TOUCHSCREEN FUNCTIONS ROUTINE 
100b is shown in FIGURE 5. It is the method by 
which touch screen function selection is carried 
out. In block 112, the algorithm 100 tests whether 
35 the fetched coordinates correspond to the 
display/remove keyboard toggle button 36. Since 
the test of block 108 has already established that 
the coordinates do correspond to one of the but- 
tons 34, 36, if the coordinates do not correspond to 
40 button 36, it follows that they must correspond to 
the other button, the touch screen function button 
34. In that case, the algorithm 100 proceeds to the 
right hand branch identified at 114 in FIGURE 5. 
On the other hand, if the coordinates do corre- 
45 spond to the toggle control button 36, then the 
algorithm 100 proceeds to the left hand branch 
identified at 116 on FIGURE 5. 

In the right hand branch 114 of FIGURE 5, in 
block 118, the function menu 38 of FIGURE 2B is 
so displayed on the touch screen, and then the al- 
gorithm 100 awaits a touch to indicate which func- 
tion is to be selected- When the computer user 
touches the menu 38, a new x,y coordinates data 
structure is produced, and, in block 120. is fetched 
55 from the x,y buffer 36 (FIGURE 1) as before. 

Then, in block 122. this newly fetched data 
structure is tested to determine whether it contains 
a valid x.y coordinates set. tf valid coordinates are 
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not received, it means, for example, that the simu- 
lated keyboard K was touched at a point other than 
along the menu entries, if that is the case, the 
algorithm 100 loops back to block 120 to again 
await a touch on the touch sensitive screen. On the 
other hand, if the x.y coordinates are valid, i.e.. 
correspond to a menu entry, then the algorithm 100 
serially tests to determine which, if any. of the 
functions of the menu 38 correspond to the coordi- 
nates. 

In block 124. the algorithm 100 tests whether 
the coordinates correspond to the first function of 
the menu 38. If the coordinates do correspond to 
the first function, then the algorithm 100 goes to 
block 126 at which the simulated keyboard K is 
activated, and the KEYBOARD ACTIVE flag in the 
flag buffer 14b of memory 14 is set, for example, 
to a value of one to indicate that condition. Then, 
the algorithm 100 returns to the KEYBOARD EN- 
TRY POINT ROUTINE 100a, as indicated at block 
128. After returning to the KEYBOARD ENTR- 
YPOINT ROUTINE 100a of FIGURE 4 from the 
TOUCHSCREEN FUNCTIONS ROUTINE 100b, al- 
gorithm 100 goes to block 102 to await another 
touch. 

If the coordinates do not correspond to the first 
function, the algorithm 100 next proceeds to block 
130, at which it tests whether the coordinates cor- 
respond to the second function. If they do, then, 
the simulated keyboard K is deactivated and the 
KEYBOARD ACTIVE flag is cleared to, for exam- 
pie, zero to indicate that condition. 

On the other hand, if the coordinates do not 
correspond to the second function, the algorithm 
100 proceeds to block 136, at which it tests wheth- 
er they correspond to the third function. If they do, 
then AUTOMATIC POSITIONING mode has been 
selected, in which case, in block 138. the AUTO- 
MATIC POSITION flag in the flag buffer 14b of 
memory 14 is set to LOGIC ONE. Then, the al- 
gorithm 100 returns to the KEYBOARD ENTR- 
YPOINT ROUTINE 100a, as described above and 
indicated at block 128. 

The TOUCHSCREEN FUNCTIONS ROUTINE 
100b next proceeds to block 140 of FIGURE 6. as 
indicated by the letter rt C" in a balloon. There, if 
the third function also was not selected, then the 
algorithm 100 tests whether the fourth function, 
manual positioning of the simulated keyboard K, 
was selected. If this mode were selected, then the 
AUTOMATIC POSITIONING flag is cleared to, for 
example, a value of zero in block 142 and position- 
ing arrows are displayed on the screen (as shown 
in FIGURE 3F) in block 144. Then, in block 146, 
the computer user manually positions the simulated 
keyboard K by touching the arrow (or arrows) cor- 
responding to the direction in which the user wish- 
es the simulated keyboard K to move. 



After this is completed, in block 148. the posi- 
tion to which the simulated keyboard K was man- 
ually re-located is stored in the keyboard position 
buffer 36 of memory 14 (FIGURE 1). Then, the 

s algorithm 100 returns to the KEYBOARD ENTR- 
YPOINT ROUTINE 100a. as described above and 
indicated at block 128. 

If, on the other hand, the coordinates did not 
correspond to the fourth function, then, the al- 

w gorithm 100 tests whether _the coordinates cor- 
respond to the fifth function, i.e., SPLIT SCREEN 
mode. This is performed in block 150. If they do 
correspond, the algorithm 100 proceeds to block 
152 at which it tests whether the AUTOMATIC 

75 POSITIONING flag has been set to, for example, a 
value of two. If it does have that value, then, in 
block 154, the algorithm 100 deactivates the SPLIT 
SCREEN mode. Next, in block 156. the algorithm 
100 causes the AUTOMATIC POSITIONING flag to 

20 be cleared to zero to indicate the deactivation of 
the SPLIT SCREEN mode. Then; the algorithm J 00 
returns to the KEYBOARD ENTRYPOINT ROUTINE 
100a, as described above and indicated at block 
128. 

25 If the AUTOMATIC POSITIONING flag pre- 

viously did not have a value of two, then the 
algorithm 100 proceeds to block 160. at which the 
SPLIT SCREEN mode is activated. Subsequently, 
in block 162, the AUTOMATIC POSITIONING flag 
30 is set to a value of two to indicate that condition. 
Then, the algorithm 100 returns to the KEYBOARD 
ENTRYPOINT ROUTINE 100a, as described above 
and indicated at block 128. 

Thereafter, if the touch coordinates do not cor- 
35 respond to the fifth function, then, in block 163, the 
algorithm 100 then tests whether they correspond 
to the sixth function, EXIT, if they do not. the 
algorithm 100 flows to block 120, as indicated by 
the "D" in a balloon. However, if EXIT was 
40 touched, then, the algorithm 100 returns to the 
KEYBOARD ENTRYPOINT ROUTINE 100a. as de- 
scribed above and indicated at block 128. 

Returning to FIGURE 5. if the test of block 112 
indicates that the display/remove keyboard toggle 
45 button 36 had been pressed, the algorithm 100 
proceeds along the left hand branch 166 to block 
164. In block 164, the algorithm 100 tests whether 
the simulated keyboard K is active, i.e., whether 
the KEYBOARD ACTIVE flag is set to a value of 
so one. If it is not, then the algorithm 100 ignores that 
touch, and returns to the KEYBOARD ENTR- 
YPOINT ROUTINE 100a, as described above and 
indicated in block 128. 

If, on the other hand, the touch screen is ac- 
55 tive. as indicated by that flag having a value of one, 
then, in block 166, the algorithm 100 tests whether 
a KEYBOARD ON flag is set to a value of one. If 
that also is set to that value, that indicates that the 
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simulated keyboard K had been displayed on the 
screen immediately prior to the touch of button 36. 
Accordingly, the algorithm 100 proceeds to block 
168, at which the KEYBOARD ON flag is cleared to 
zero, and, then, to block 170, at which a DISPLAY 
KEYBOARD ROUTINE 100C is called. (That routine 
will be described shortly.) On the other hand, if the 
KEYBOARD ON flag is not set to a value of one, 
which would mean that, immediately prior to button 
36 having been pressed, the simulated keyboard K 
had not been displayed on screen, then the al- 
gorithm 100 proceeds to block 172, at which the 
KEYBOARD ON flag is set to a value of one, and, 
then, to block 174, at which the DISPLAY KEY- 
BOARD ROUTINE 100C is called. 

The DISPLAY KEYBOARD ROUTINE 100c is 
depicted in FIGURE 7. In this routine, the algorithm 
100 first determines, in block 190, whether the 
simulated keyboard K is displayed, by determining 
whether the KEYBOARD ON flag stored in the flag 
buffer 14b of memory 14 (FIGURE 1) has a value 
of one. If it is displayed, then, in block 192. it is 
removed from the screen and the algorithm 100 
returns, as indicated in block 194, to the previous 
routine from which the DISPLAY KEYBOARD ROU- 
TINE 100C was entered. 

If the test of block 190 determines that the 
simulated keyboard K is displayed, the algorithm 
100 next tests in block .196 whether the KEY- 
BOARD ACTIVE flag is set to a value of one to 
indicate that the simulated keyboard K is active. If 
it is not active, then, in block 197, the simulated 
keyboard K is removed from the screen. After- 
wards, the algorithm 100 returns, as indicated in 
block 194, to the previous routine from which the 
DISPLAY .^KEYBOARD ROUTINE 100C was en- 
tered. 

On the other hand, if the simulated keyboard K 
is active, then the algorithm 1 00 proceeds to block 
198. In this block, the algorithm 100 determines 
whether the AUTOMATIC POSITIONING flag has a 
value of respectively zero. If the value is zero, then, 
in block 202, the algorithm 100 tests whether the 
simulated keyboard K is displayed. This is per- 
formed by determining whether the KEYBOARD 
DISPLAY flag stored in the flag buffer 14b of the 
memory 14 (FIGURE 1) has a value of one. If that 
flag has that value, then the algorithm 100 returns, 
as indicated in block 194, to the previous routine 
from which the DISPLAY KEYBOARD ROUTINE 
100C was entered. 

if the simulated keyboard K is not displayed, 
however, then the algorithm 100 jumps to block 
204. In block 204, the simulated keyboard K is 
displayed at the screen location identified by the 
contents of the KEYBOARD POSITION buffer 36 
(FIGURE 1). Afterwards, in block 206, the KEY- 
BOARD DISPLAY flag is set to a value of one. 



Then, the aigorithm 100 returns, as indicated in 
block 194, to the previous routine from which the 
DISPLAY KEYBOARD ROUTINE 100C was en- 
tered. 

s Returning the discussion to block 198, if the 

AUTOMATIC POSITIONING flag does not have a 
value of zero, it again is tested, this time in block 
208 to determine whether it has a value of one. If 
the value is one, then, in block 210. the cursor 
io location is fetched from the cursor control 35 and is 
compared with the keyboard location stored in the 
keyboard position buffer 36. If the locations do not 
conflict, i.e.. if the cursor location does not fall 
within the keyboard location, then the algorithm 
15 100 proceeds to block 212. 

There, the algorithm 100 tests whether the 
simulated keyboard K is displayed by determining 
whether the KEYBOARD DISPLAY flag has a value 
of one. If it is displayed,* then the algorithm 100 
20 returns, as indicated in block 194, to the previous 
routine from which the DISPLAY KEYBOARD ROU- 
TINE 100C was entered. If the keyboard K is not 
displayed, then, in block 214. the simulated key- 
board K is displayed at that keyboard location. 
25 On the other hand, if the cursor and keyboard 

locations conflict, then the algorithm 100 proceeds 
to block 216. There, the cursor location is tested to 
determine whether it falls within the top half of the 
screen, which, for example, in a display having 25 
30 lines in the y-directions is the top 12 lines of the 
screen. If it does fall within the top half, then, in 
block 218, the keyboard location coordinates are 
reset to position the simulated keyboard K in the 
bottom half of the display. Afterwords, the algo- 
35 rithm 100 proceeds to block 204, wherein the simu- 
lated keyboard K is displayed at that location, as 
described above. 

If the cursor location does not fall within the top 
half of the screen, then, in block 220, the keyboard 
40 coordinates are set to the top half, and the al- 
gorithm 100 goes to block 204, wherein the simu- 
lated keyboard K is displayed at that location, as 
described above. 

Returning to block 208, if the AUTOMATIC 
45 POSITIONING flag tested in that block does not 
equal one, then it must have a value of two. which 
indicates that SPLIT SCREEN mode was selected. 
The algorithm 100 then proceeds to block 222, at 
which it tests whether the mode was already se- 
50 lected. If so, then the algorithm 100 returns, as 
indicated in block 194. to the previous routine from 
which the DISPLAY KEYBOARD ROUTINE 100C 
was entered. 

Otherwise, in block 224 the algorithm 100 next 
55 inquires whether the LCD display is of sufficient 
size to produce legible screens in SPLIT SCREEN 
mode, for example, whether it is a 640 x 400 
display. If not, the SPLIT SCREEN mode would not 
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be suitable, and, in block 226, the simulated key- 
board K is deactivated by changing the KEY- 
BOARD ACTIVE flag to zero. Then, the algorithm 
100 goes to block 194, and then returns to the 
previous routine. 

If the display is of a suitable size, then, in block 
228, the display contoller 20 automatically is re- 
programmed to drive the display in SPLIT 
SCREEN mode. In other words, the screen is 
driven as though it were two separate screens, for 
example, one physically above the other as shown 
in FIGURE 3G. Preferably, both parts of the split 
screen are in CGA mode. 

With this done, in block 230. the simulated 
keyboard K is displayed in the bottom half of the 
screen while the normal software output is dis- 
played in the top. or vica versa. Then, the al- 
gorithm 100 returns, as indicated in block 194, to 
the previous routine from which the DISPLAY KEY- 
BOARD ROUTINE 100C was entered. 

After the DISPLAY KEYBOARD ROUTINE 100c 
is completed, the algorithm 100 returns to the 
KEYBOARD ENTRYPOINT ROUTINE 100a, as de- 
scribed above and indicated at block 128. 

Continuing now with the KEYBOARD ENTR- 
YPOINT ROUTINE 100a f and, in particular, continu- 
ing the description of block 108, if the fetched 
coordinates are not those of touch screen function 
buttons 34, 36, then the algorithm 100 proceeds to 
block 232. In that block, the algorithm 100 tests 
whether the simulated keyboard K is active, i.e., 
the KEYBOARD ACTIVE flag is set to a value of 
one. If not the touch is ignored and the algorithm 
100 proceeds to block 106 as described above. 

If, however, the simulated keyboard K is active, 
then, in block 236, the algorithm 100 again calls 
and executes the DISPLAY KEYBOARD ROUTINE 
100C of FIGURE 7, as described above. 

Afterwards, in block 238, the algorithm 100 
fetches the next set of coordinates from the x,y 
buffer 14a, as described above. The algorithm 100 
then, in block 240, tests whether these are valid, 
again as described above. If the coordinates are 
not valid, they are ignored and the algorithm 100 
proceeds to block 106, as described above. On the 
other hand if the coordinates are valid, the al- 
gorithm 100 in block 242 proceeds to the TOUCH- 
SCREEN TRANSLATE ROUTINE 100d of FIGURE 
8. 

In FIGURE 8. the TOUCHSCREEN TRANS- 
LATE ROUTINE 100d translates the set of coordi- 
nates of a touch on the simulated keyboard K into 
a character-identifying signal. The term "character" 
in the foregoing term is used in a comprehensive 
sense to denote an alpha-numeric character, punc- 
tuation, or other symbol, or function identified by 
the selection and pressing (i.e. touching) of a key 
on the simulated keyboard K by the computer user. 



A complication arising in this translation is due 
to the mobility (i.e., re-positioning) of the simulated 
keyboard K on the touch screen. Since the simu- 
lated keyboard K can be moved to any of a variety 

5 of locations on the screen, it is necessary to deter- 
mine an offset in the x- and y- directions of the 
simulated keyboard K from a fixed point of refer- 
ence, or origin, e.g. the upper left hand corner pixel 
of the screen. Preferably, this origin is the same as 

70 used in determining the set ^.coordinates of the 
touch. 

For these purposes, any time the position of 
the simulated keyboard K is changed (regardless of 
whether the simulated keyboard K is in the MAN- 

75 UAL POSITIONING. AUTOMATIC POSITIONING or 
SPLIT SCREEN mode), the CPU 12 calculates the 
offset in the x- direction (Le.. the "column offset") 
and in the y-direction (i.e., the "row offset"). This 
offset is stored in the KEYBOARD OFFSET buffer 

20 14d in the memory 14. 

Then, since the relative location of each key 
within the keyboard is known, and the offset to the 
keyboard is known, the precise location on the 
screen of each key can be computed. 

25 With that introduction, FIGURE 8 can now be 

described starting with blocks 242 and 244, at 
which the row and column offsets, respectively, are 
fetched from the KEYBOARD OFFSET buffer 14d. 
Next, in blocks 246 and 248 the algorithm 100 

30 calculates a value for the x- coordinate into the 
column which is identified by the x-coordinate of 
the touch, and calculates a y-coordinate into the 
row which is identified by the y-coordinate of the 
touch. These are called respectively the w x col- 

35 umn" and n y row". Then, in blocks 250 and 252, 
the respective row and column offsets are sub- 
tracted from the values of the x column and y row 
to yield new coordinates which define the location 
of a "touched" key within the keyboard window 

40 itself. 

Then, in block 254, using the new x-column\y- 
row coordinates as an index into the character 
table stored in the CHARACTER TABLE buffer 14e 
of the memory 14 (FIGURE 1), an entry in that 

45 table is identified, and, in block 256, fetched. The 
algorithm 100, in block 258, places the fetched 
character in the CHARACTER buffer 14f in memory 
14. Afterwords, the algorithm 100 returns, in block 
260, to the KEYBOARD ENTRYPOINT ROUTINE 

so 100a. 

There, the algorithm 100 proceeds with block 
106, as described above, in which normal DOS 
keyboard processing takes place, and then, in 
block 250. returns to begin algorithm 100 over 
55 again. 

An appreciation of the present invention can be 
had by considering the use of the invention in a 
compact, general-purpose lap-top computer, which 
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uses either a conventional external keyboard or a 
built-in touch-sensitive display. For running stan- 
dard software packages, such as those mentioned 
above, a simulated keyboard having a full com- 
plement of keys arranged in either the conventional 
QWERTY or an alphabet format can be displayed. 

Employing the simulated keyboard for entering 
information and instructions using the disclosed 
computer often is more convenient then using an 
external keyboard. For example, it would be un- 
wieldy to use an external keyboard when the dis- 
closed computer is being used in an automobile or 
airplane. Furthermore, it would be awkward to use 
an external keyboard while the user is ambulatory. 
In addition, it makes sense to eliminate such pe- 
ripherals in order to take full advantage of the 
compact design of the computer. Thus, the advan- 
tages of the present invention are evident. 

The foregoing description has been limited to a 
specific embodiment of this invention. It will be 
apparent, however, that variations and modifica- 
tions may be made to the invention, with the attain- 
ment of some or all of its advantages. Therefore, it 
is the object of the appended claims to cover all 
such variations and modifications as come within 
the true spirit and scope of the invention. 



Claims 

1 . A general-purpose computer system comprising: 

A) computer means for receiving an input, run- 
ning any of a plurality of application programs, 
generating an output in response to said ap- 
plication program being run, and generating a 
simulated keyboard independent of said applica- 
tion program being run; and 

B) a touch-sensitive display connected to said 
computer means for concurrently displaying 

i) said output from said computer means, and 

ii) said simulated keyboard for manually sup- 
plying said input to said computer means. 

2. The general-purpose computer system in accor- 
dance with claim 1, wherein said simulated key- 
board can be displayed on said touch-sensitive 
display in a position thereon determined by said 
computer means, and said computer means in- 
cludes means responsive to said input for manually 
changing said position of said simulated keyboard. 

3. The general-purpose computer system in accor- 
dance with claim 2, wherein said simulated key- 
board can be displayed on said touch-sensitive 
display in a position thereon determined by said 
computer means, said computer means includes 
means for generating a cursor, said touch-sensitive 
display can display said cursor concurrently with 
said output and said simulated keyboard, and said 
computer means further includes means for chang- 



ing said position of said simulated keyboard in 
response to said position of said cursor. 

4. The general-purpose computer system in accor- 
dance with claim 3, wherein said computer means 

s can cause a first and second portion of said output 
to be displayed concurrently 

(i) in a first mode in which said first portion of said 
output appears in a first portion of said touch- 
sensitive display, and a second portion of said 

70 output appears in a second -portion of said touch- 
sensitive display, and 

(ii) in a second mode in which said first and second 
portions of said output appear concurrently in said 
first portion of said touch-sensitive display, and 

75 said computer means can further cause said simu- 
lated keyboard to be displayed in said second 
portion of said touch-sensitive display. 

5. The general-purpose computer system in accor- 
dance with claim 1 f wherein said simulated key- 

20 board can be displayed on said touch-sensitive 
display in a position thereon determined by said 
computer means, said computer means includes 
means for generating a cursor, said touch-sensitive 
display can display said cursor concurrently with 

25 said output and said simulated keyboard, and said 
computer means further includes means for chang- 
ing said position of said simulated keyboard in 
response to said position of said cursor. 

6. The general-purpose computer system in accor- 
30 dance with claim 1 , wherein said computer means 

can cause a first and second portion of said output 
to be displayed concurrently 

(i) in a first mode in which said first portion of said 
output appears in a first portion of said touch- 

35 sensitive display, and a second portion of said 
output appears in a second portion of said touch- 
sensitive display, and 

(ii) in a second mode in which said first and second 
portions of said output appear concurrently in said 

40 first portion of said touch-sensitive display, and 

said computer means can further cause said simu- 
lated keyboard to be displayed in said second 
portion of said touch-sensitive display. 

7. A method of computing using a touch-sensitive 
45 display, said method comprising the steps of: 

A) using a general-purpose computer for receiv- 
ing an input, running any of a plurality of ap- 
plication programs, generating an output in re- 
sponse to said application program being run, 

so and generating a simulated keyboard indepen- 
dent of said application program being run; 

B) concurrently displaying on said touch-sen- 
sitive display 

i) said output from said computer, and 
55 ii) said simulated keyboard; and 

C) manually supplying said input to said com- 
puter means using said touch-sensitive display. 

8. The computing method in accordance with claim 
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7, wherein said simulated keyboard displaying step 
includes displaying said simulated keyboard on 
said touch-sensitive display in a position thereon 
determined by said computer means in response 
to said input. 5 

9. The computing method in accordance with claim 
7, further including the step of displaying a tool for 
manually entering a position in which said simu- 
lated keyboard is to be displayed on said touch- 
sensitive display. *o 

10. The computing method in accordance with 
claim 7, further including displaying a cursor at a 
position on said touch-sensitive display, and 
wherein said simulated keyboard displaying step 
includes displaying said simulated keyboard at a 75 
position on said touch-sensitive display in response 

to said position thereon of said cursor. 

11. The computing method in accordance with 
claim 7, further including the steps of: 

(i) in a first mode, displaying a first and second 20 
portion of said output in respective first and 
second portions of said touch-sensitive display, 

and 

(ii) in a second mode, displaying said first and 
second portions of said output in said first por- 25 
tion of said touch-sensitive display. 

12. A method of displaying a computer output, said 
method comprising the steps of: 

(i) in a first mode, displaying a first and second 
portion of said output in respective first and 30 
second portions of a touch-sensitive display, 

and 

(ii) in a second mode, displaying said first and 
second portions of said output in said first por- 
tion of said touch-sensitive display. 35 

13. The method in accordance with claim 12, fur- 
ther including the step of, in said second mode, 
displaying a simulated keyboard in said second 
portion while said first and second output portions 

are displayed in said first portion. 40 

14. The method in accordance with claim 12, 
wherein in said second mode, said first and second 
displayed output portions are compressed in 
height. 

15. A method of displaying a simulated keyboard 45 
on a touch-sensitive display, said method compris- 
ing the steps of. 

A) providing a plurality of simulated keyboard 
positioning techniques including at least a man- 
ual positioning technique and an automatic posi- so 
tioning technique, 

B) selecting one of said simulated keyboard 
positioning techniques, and 

D) positioning said simulated keyboard on said 
touch-sensitive display in accordance with the 55 
positioning technique selected. 

16. The method in accordance with claim 15, 
wherein said providing step includes displaying a 



menu of simulated keyboard positioning techniques 
on said touch-sensitive display, and said selecting 
step includes, in response to a manual touch on 
said touch-sensitive display, selecting one of said 
simulated keyboard positioning techniques. 

17. The method in accordance with claim 16. fur- 
ther including the steps of 

A) displaying a control button on said touch- 
sensitive display, and 

B) manually touching the control button to cause 
said menu to appear on said display. 

18. A method of displaying a simulated keyboard 
on a touch-sensitive display, said method compris- 
ing the steps of: 

A) displaying a control button on said touch- 
sensitive display, and 

B) displaying said simulated keyboard in re- 
sponse to a touch on said control button. 

19. The method in accordance with claim 18, fur- 
ther including the step of removing the display of 
said simulated keyboard from said touch-sensitive 
display in response to a second touch thereon:- 

20. The method in accordance with claim 18; fur- 
ther including 

A) displaying a second control button on said 
touch-sensitive display. 

B) activating said simulated keyboard in re- 
sponse to a touch on said second control but- 
ton, and 

C) wherein said first control button only will 
cause said simulated keyboard to be displayed 
when said simulated keyboard is activated..; 
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